ORIGINAL ARTICLE 


Infect Dis Clin Microbiol 2022; 4(4): 244-51 


Comparison of CURB-65 Pneumonia Severity 
Score, Quick COVID-19 Severity Index, and 
Brescia-COVID Respiratory Severity Scale in 
Emergently Hospitalized COVID-19 Patients 


with Pneumonia 


ibrahim Toker1@®, Aysin Kiling-Toker2 @, Ayse Turunc-Ozdemir2 @, Miikerrem Altuntas'® 


1 Department of Emergency Medicine, Kayseri City Hospital, Kayseri, Turkey 


2 Department of Infectious Disease and Clinical Microbiology, Kayseri City Hospital, Kayseri, Turkey 


ABSTRACT 


Objective: This study aimed to assess the performance of the CURB-65, the quick COVID-19 
severity index (qCSI), and the Brescia-COVID respiratory severity scale (BCRSS) scores in 


hospitalized patients with COVID-19 pneumonia. 


to compare the areas under the two ROC (receiver operating 


actualized ROC analyses of the CURB-65, the qCSI, and the BC 
ROC curves of these three scores. 


Results: The median age of the patients was 73, and 63.6% (n=164 


RSS scores and compared 


tients, 29.5% (n=76) were hospitalized in the intensive care uni 


predicting ICU (intensive care unit) hospitalization and in-hospital mortality in emergently 


Materials and Methods: We retrospectively reviewed the emergently hospitalized 258 pa- 
tients with COVID-19 pneumonia consecutively. The required sample size was calculated 
characteristic) curves (AUC) 
using the MedCalc 20.0 program (MedCalc Software Ltd., Ostend, Belgium). In addition, 


we 
the 


were male. Of 258 pa- 


t (ICU), and 15.9% (n=41) di 


ed. 


The CURB-65 and the qCSI scores predicted ICU admission at a moderate level (p<0.001; 


AUC values were 0.743 and 0.723, respectively). However, the predic 


tive effect of the BCRSS 


score for ICU admission was lower (p<0.001; AUC value was 0.667). The CURB-65 predicted 
was 0.762). However, the pre- 


in-hospital mortality at a moderate level (p<0.001; AUC value 


dictive effect of the qCSI and the BCRSS scores for in-hospital morta 


and p=0.012, respectively; AUC values were 0.655 and 0.612, respectively). 


ity were lower (p<0.001 


Conclusion: The CURB-65 score predicted ICU hospitalization and in-hospital mortality bet- 
ter than the qCSI and the BCRSS scores. Also, the qCSI score predicted ICU admission better 
than the BCRSS score.The predictive effect of the BCRSS score was the lowest. We recom- 
mend future studies to evaluate the value and utility of COVID-19 risk classification models. 
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Comparison of CURB-65 Score, qCSI, and BCRSS Scale in COVID-19 


INTRODUCTION 


oronavirus disease 2019 (COVID-19) occurred 

with different levels of severity, and different 

criteria for hospitalizations were suggested, 
considering risk factors for poor outcomes, such 
as advanced age, comorbidities, lymphopenia, and 
high C-reactive protein (CRP) levels (1). The most se- 
vere complication of COVID-19 is viral pneumonia, 
which is often manifested by diffuse bilateral lung 
involvement (1,2). 


Various prognostic scales were developed to evalu- 
ate the indication for hospital or ICU admission and 
the severity of the disease in community-acquired 
pneumonia, and the suitability of these scales in 
patients with primary viral pneumonia was inves- 
tigated (3). For COVID-19 pneumonia, non-specific 
predictive scales were evaluated (2). However, spe- 
cific predictive risk estimation scores for COVID-19 
pneumonia were needed to facilitate clinicians’ 
decisions regarding hospitalization and admission 
ocation. Accordingly, a study by Rodriguez-Nava 
et al. evaluated the performance of the CURB-65 
score, the quick COVID-19 severity index (qCSI) 
score, and the Brescia-COVID Respiratory Severity 
Scale (BCRSS) score in predicting in-hospital mor- 
tality and ICU admission in patients with COVID-19 
illness (4). This study sought to provide a cohort val- 
idation of the previous study for further evidence. 


Severity scores are valuable tools to predict in-hos- 
pital outcomes and guide clinicians’ treatment de- 
cisions. For example, the CURB-65 score (confusion, 
BUN >19 mg/dL, respiratory rate >30, low blood 
pressure, and age >65 years) used in the emergency 
department (ED) was developed as a clinical predic- 
tion rule in patients with pneumonia. The CURB-65 
score can be easily measured during the first evalu- 
ation of patients in ED (5-7). Moreover, two prognos- 
tic risk scores developed specifically for COVID-19 
and easy to use in the ED are of interest: the qCSI 
and the BCRSS. The qgCSI score predicts critical 
conditions defined by high-flow oxygen demand, 
non-invasive or invasive ventilation, or death in the 
first 24 hours (8). On the other hand, the BCRSS in- 
cludes respiratory rate, oxygen saturation, and re- 
spiratory examination characteristics of the patient 
and offers treatment recommendations (9). 
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Our study aimed to evaluate the performance of the 
CURB-65, the qCSI, and the BCRSS scores in predict- 
ing ICU hospitalization and in-hospital mortality in 
emergently hospitalized patients with COVID-19 
pneumonia. 


MATERIALS AND METHODS 


We conducted a retrospective study in Kayser City 
Hospital between March 2022 and April 2022. Kay- 
seri City Hospital’s Ethics Committee approved this 
study on Jun 2, 2022, with the approval code 647. We 
waived informed consent because of the retrospec- 
tive nature of the study. 


Study Population 

We retrospectively reviewed the emergently hospi- 
talized patients with COVID-19 pneumonia consec- 
utively. A confirmed case of COVID-19 was defined 
aS a positive reverse transcriptase-polymerase 
chain reaction (RT-PCR) analysis of a nasopharyn- 
geal swab sample. We included only laboratory-con- 
firmed cases that had pulmonary involvement. The 
primary endpoint of our study was in-hospital mor- 
tality and ICU admission. 


Severity Scores 

CURB-65 Score: The CURB-65 score (confusion, BUN 
>19 mg/dL, respiration speed >30/min, low blood 
pressure (systolic BP <90 mm Hg or diastolic BP <60 
mm Hg), age >65 years), which is used to determine 
the need for hospitalization in adults diagnosed with 
community-acquired pneumonia, has a low level 
of evidence. The CURB-65 score varies from 0 to 5. 
A score between 0-1 indicates a low mortality risk, 
while 2 and above indicate higher mortality (10). 


HIGHLIGHTS 
e The pneumonia severity scores are valuable tools 
for guiding clinicians’ treatment decisions. 


e The CURB-65 score predicted ICU hospitalization 
and in-hospital mortality better than the qCSI 
and the BCRSS scores. 


e The qCSI score predicted ICU admission better 
than the BCRSS score. 
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Quick COVID-19 Severity Index (qCSI): The qCslI 
is a 12-point scale that uses only three variables 
available at the bedside: 1) nasal cannula flow rate, 
2) respiratory rate, and 3) the minimum measured 
pulse oximetry value. According to scores, there are 
four risk strata: 0-3 low, 4-6 low-intermediate, 7-9 
high-intermediate, and 210 high risks (8). 


Brescia-COVID Respiratory Severity Scale (BCRSS): 
The BCRSS used during the initial assessment in- 
cludes the following risk factors: 1) the presence 
of wheezing or when the patient is unable to com- 
plete a full sentence at rest or with minimal effort, 
2) the respiratory rate is greater than 22, 3) the ox- 
y! 
fe) 


e. 


7 


gen saturation is below 90%, and 4) the presence 
f bilateral or diffuse infiltrates on lung imaging (9). 
Patients are classified into five risk tiers based on 
these risk factors. 


Sample Size 

Based on the previously mentioned research (4), 
we calculated the required sample size to compare 
the areas under the two ROC (receiver operating 
characteristic) curves (AUC) using the MedCalc 20.0 
program (MedCalc Software Ltd., Ostend, Belgium). 
Assuming that the correlation is 0.4 in both the 
positive and negative cases, and the sample size 
ratio in the negative/positive groups is 2 (i.e., the 
mortality rate is 33%), we calculated a total sample 
size of 243 at a= 0.20 and 95% power. 


Data Collection 

We conducted a retrospective study between Mar 1, 
2022, and Apr 1, 2022, and the ED doctors recorded 
patients’ medical data on the data collection form. 
The patients’ fever, pulse, blood pressure, respirato- 
ry rate, and oxygen saturation values were recorded 
in the medical data by the emergency nurses. The 
ED physician recorded the patient’s state of con- 
sciousness, the amount of oxygen taken by nasal or 
mask, and detailed respiratory physical examina- 
tion findings in the patient’s medical data. The prin- 
cipal abstractor recorded the BUN value from the 
laboratory values of the patients in the data col- 
lection form. The radiology physician reported the 
lung imaging findings of the patients (all patients 
had thorax tomography) according to the COVID-19 
Reporting and Data System (CO-RADS) classifica- 
tion system (11). Study patients had all CO-RADS 4 
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or 5. Two blinded infectious disease physicians cal- 
culated the scores using data collection forms and 
medical data in the study. 


Statistical Analysis 

Statistical analyzes were performed using the Sta- 
tistical Package for the Social Sciences (SPSS) 26.0 
(IBM Corp., Armonk, NY, USA) and MedCalc 20.0 
program (MedCalc Software Ltd., Ostend, Belgium). 
We showed the categorical data as frequency and 
percentage, the continuous data as the mean + 
standard deviation for the normally distributed 
data, and the median 25%-75% interquartile rang- 
es (IQRs) for non-normally distributed. We used 
the Chi-square test for categorical variables. We 
used the Mann-Whitney U test for two-group com- 
parisons of non-normally distributed continuous 
variables and independent sample t-tests to com- 
pare normally-distributed continuous variables. 
We performed ROC analyses of CURB-65, qCSI, and 
BCRSS scores and compared the ROC curves of 
these three scores. For descriptive statistics, AUC 
value, sensitivity, specificity, positive predictive 
value (PPV), negative predictive value (NPV), posi- 
tive likelihood ratio (LR+), and negative likelihood 
ratio (LR-) are shown. Statistical significance was 
set as p<0.05. 


RESULTS 


During the study period, 1162 patients visited the 
pandemic ED; 378 were hospitalized with a prelim- 
inary diagnosis of COVID-19. Ninety-two patients 
were excluded from the study because they tested 
negative in PCR, and twenty-eight patients were 
excluded because of missing data. A total of 258 
patients consecutively hospitalized were included 
in the study. Chest computed tomography (CT) was 
performed in all patients as pulmonary imaging. 


The median age of the patients was 73 years IQRs 
(64- 82) (min: 24 max: 110), and 63.6% (n=164) were 
male. 29.5% (n=76) of the patients were admitted to 
the ICU, and 15.9% (n=41) died. The most common 
comorbidities were hypertension (39.1%), chron- 
ic obstructive pulmonary disease (COPD) (36.7%), 
and diabetes mellitus (30.2%). We showed patients’ 
characteristics in Table 1. 
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Table 1. Demographic and clinical characteristics of emergently hospitalized patients with COVID-19 pneumonia. 


non-ICU ICU p Survive Death Total p 
Age (year) mean + SD 70.4413.8 74.5414.3 0.029* 70.64£14.4 77+#10.9 71.6414 0.007* 
Gender n (%) 
Female 65 (35.7) 29 (38.2) 79 (36.4) 15 (36.6) 94 (36.4) 
0.710 0.982 
Male 117 (64.3) 47 (61.8) 138 (63.6) 26 (63.6) 164 (63.6) 
Comorbidities n (%) 
Hypertension 69 (37.9) 32 (42.1) 0.529 79 (36.4) 22 (53.7) 101(39.1) 0.038 
DM 51 (28) 27 (35.5) 0.232 67 (30.9) 11 (26.8) 78 (30.2) 0.605 
COPD 70 (38.5) 27 (35.5) 0.657 86 (39.6) 11 (26.8) 97 (36.7) 0.121 
cvD 42 (23.1) 25 (32.9) 0.101 53 (24.4) 14 (34.1) 67 (26) 0.193 
CKD 22 (12.1) 13 (17.1) 0.283 28 (12.9) 7 (17.1) 35 (13.6) 0.475 
Malignancy 13 (7.1) 6 (7.9) 0.833 13 (6) 6 (14.6) 19 (7.4) 0.052 
CURB-65 score n (%) 
Oor1 81 (44.5) 12 (15.8) 89 (41) 4 (9.8) 93 (36) 
2 81 (44.5) 27 (35.5) <0.001 95 (43.8) 13 (31.7) 108 (41.9) <0.001 
S3 20 (11) 37 (48.7) 33 (15.2) 24 (58.5) 57 (22.1) 
qCSI score n (%) 
<3 68 (37.4) 7 (9.2) 69 (31.8) 6 (14.6) 75 (29.1) 
4-6 51 (28) 15 (19.7) 60 (27.6) 6 (14.6) 66 (25.6) 
<0.001 0.004 
7-9 30 (16.5) 21 (27.6) 37 (17.1) 14 (34.1) 51 (19.8) 
10-12 33 (18.1) 33 (43.7) 51 (23.5) 15 (36.6) 66 (25.6) 
BCRSS score n (%) 
0 36 (19.8) 5 (6.6) 37 (17.1) 4 (9.8) 41 (15.9) 
1 57 (31.3) 11 (14.5) 62 (28.6) 6 (14.6) 68 (26.4) 
2 36 (19.8) 20 (26.3) <0.001 47 (21.7) 9 (22) 56 (21.7) 0.031 
3 34 (18.7) 26 (34.2) 43 (19.8) 17 (41.5) 60 (23.3) 
4 19 (10.4) 14 (18.4) 28 (12.9) 5 (12.2) 33 (12.8) 
LOS in hospital median (day) (IQRs) 7 (6-10) 11 (7-20) <0.001** 8 (6-11) 11 (6.5-17.5) 8 (6-12) 0.015** 
*p= Student's t-test, **p= Mann-Whitney U test. The chi-square test calculated other p values. 


ICU: Intensive care unit, SD: Standard deviation, DM: Diabetes mellitus, LOS: Length of stay, COPD: Chronic 
obstructive pulmonary disease, CVD: Cardiovascular disease, CKD: Chronic kidney disease, qCSI: Quick COVID-19 


severity index, BCRSS: Brescia-COVID respiratory severity scale, IQR: Interquartile range. 


There was no significant difference between gen- dead (ICU admission: 74.5 vs. 70.4; in-hospital mor- 
der and comorbidities regarding ICU admission _ tality: 77 vs. 70.6; p=0.029 and p=0.007, respective- 
and in-hospital mortality, except hypertension in — ly). The median length of stay (LOS) in the hospital 
in-hospital mortality. However, the mean age of pa-_ was higher in patients admitted to ICU and dead 
tients was higher in patients admitted to ICU and __(p<0.001 and p=0.015, respectively). There was a sig- 
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Table 2. CURB-65, qCSI, and BCRSS scores’ power to predict ICU admission. 


Cut-off AUC (p) Sea poe Bs io, LR+ LR- 
CURB-65 S2 0.743 (<0.001) 48.6 89 64.9 80.6 44 0.58 
qcsl 25 0.723 (<0.001) 84.2 55.4 44.1 89.4 1.89 0.28 
BCRSS =i 0.667 (<0.001) 78.9 S11 40.3 85.3 1.61 0.41 
AUC: The area under the receiver operating characteristic curve, qCSI: Quick COVID-19 severity index, 
BCRSS: Brescia-COVID respiratory severity scale, PPV: Positive predictive value, NPV: Negative predictive 
value, LR: Likelihood ratio. 
Table 3. CURB-65, qCSI, and BCRSS scores’ power to predict death. 
Cut-off AUC (p) eS see phe ie LR+ LR- 
CURB-65 >2 0.762 (<0.001) 58.5 84.7 42.1 915 3.85 0.49 
qcsl 5 0.655 (<0.001) 82.9 48.8 23.4 93.8 1.62 0.35 
BCRSS >1 0.612 (0.012) 754 45.6 20.8 90.8 1.39 0.53 
AUC: The area under the receiver operating characteristic curve, qCSI: Quick COVID-19 severity index, 


BCRSS: Brescia-COVID respiratory severity scale, PPV: Positive predictive value, NPV: Negative predictive 


value, LR: Likelihood ratio. 


nificant difference between the CURB-65, the qCSI, 
and BCRSS scores regarding ICU admission and 
in-hospital mortality (p<0.005) (Table 1). 


The Performance of the Scores 

The sensitivity, specificity, PPV, NPV, +LR, and -LR 
values of the three scores in terms of predicting 
ICU admission and in-hospital death at different 
threshold values are presented in Tables 3 and 4. 


Overall, the predictive effect of the CURB-65 score 
was better than the qCSI and the BCRSS scores re- 
garding ICU admission and in-hospital mortality. 
The CURB-65 and the qCSI scores predicted ICU ad- 
mission at a moderate level (p<0.001; AUC values 
were 0.743 and 0.723, respectively). However, the 
predictive effect of the BCRSS score for ICU admis- 
sion was lower (p<0.001; AUC value was 0.667). The 
CURB-65 score showed no significant difference 
from the qCSI and the BCRSS scores regarding the 
predictive effect for ICU admission (p=0.6268 and 
p=0.0802, respectively) (Figure 1). When the CURB- 
65 score was higher than 2, it had a sensitivity of 
48.6%, a specificity of 89%, a PPV of 64.9%, a NPV of 
80.6%, a positive likelihood ratio of 4.4, and a neg- 
ative likelihood ratio of 0.58 for predicting ICU ad- 


mission. Besides, when the qCSI score was higher 
than 5, it had a sensitivity of 84.2%, a specificity of 
55.4%, PPV of 44.1%, NPV of 89.4%, LR+ of 1.89, and 
LR- of 0.28 for predicting ICU admission. (Table 2, 
Figure 1). 


The CURB-65 predicted in-hospital mortality at a 
moderate level (p<0.001; AUC value was 0.762). On 
the other hand, the predictive effect of the qCSI 
and the BCRSS scores for in-hospital mortality were 
low (ps0.001 and p=0.012, respectively; AUC values 
were 0.655 and 0.612, respectively). In addition, the 
CURB-65 score significantly differed from the qCSI 
and BCRSS scores regarding the predictive effect 
for in-hospital mortality (p=0.0061 and p=0.0019, 
respectively) (Figure 2). The CURB-65 score higher 
than 2 had a sensitivity of 58.5%, a specificity of 
84.7%, PPV of 42.1%, NPV of 91.5%, LR+ of 3.85, and 
LR- of 0.49 for predicting in-hospital mortality (Ta- 
ble 3, Figure 2). 


DISCUSSION 
Our study evaluated the performance of the CURB- 


65, the qCSI, and the BCRSS scores in predicting 
ICU admission and in-hospital mortality in pa- 
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AUC: The area under the receiver operating characteristic curve, qCSI: Quick 
COVID-19 severity index, BCRSS: Brescia-COVID respiratory severity scale. 


Figure 1. ROC curves for ICU admission for the CURB-65, qCSI, and BCRSS 


scores. 


Georee AUC vs. vs. vs. Score AUC vs. vs. vs. 
(95% Cl) CURB-65 qcsl BCRSS (95% Cl) CURB-65 qcsl BCRSS 
CURB-65 0.743 (0.685- 0.795) - 0.6268 0.0802 CURB-65 0.762 (0.705-0.813) 0.0061 0.0019 
qcsl 0.723 (0.665- 0.777) 0.6268 - 0.0417 qcsl 0.655 (0.593-0.712) 0.0061 - 0.2474 
BCRSS 0.667 (0.606- 0.725) 0.0802 0.0417 - BCRSS 0.612 (0.550-0.672) 0.0019 0.2474 - 


AUC: The area under the receiver operating characteristic curve, qCSI: Quick 
COVID-19 severity index, BCRSS: Brescia-COVID respiratory severity scale. 


Figure 2. ROC curves for death for the CURB-65, qCSI, and BCRSS scores. 


tients with COVID-19 pneumonia. The CURB-65 
had the highest AUC for predicting ICU admission 
and in-hospital mortality. Also, the qCSI score had 
a good AUC for ICU admission. 


Mortality rates in COVID-19 have been reported at 
different rates, such as 4.2% and 20.9%, in various 
studies (1, 12). However, in our study, in-hospital 
mortality was high (15.9%) because the patient’s 
median age was 73 years, and they had pneumonia. 


The CURB-65 score predicts the 30-day fatality in 
community-acquired pneumonia to aid in identi- 
fying inpatient or outpatient treatment, and it is 
also used in COVID-19 (13). Various studies have 
demonstrated that the CURB-65 score is a good pre- 
dictor of in-hospital mortality in COVID-19 (3, 14). 


Toker i et al. 


The qCSI (including respiratory rate, pulse oxime- 
try, and oxygen flow rate), a simple scoring system, 
predicts a 24-hr risk of critical respiratory illness 
in patients admitted from ED with COVID-19 (8). 
In a retrospective study of 313 patients, while the 
CURB-65 and qCSI scoring systems performed well 
in predicting in-hospital mortality, the qCSI and 
the BCRSS scores performed well in predicting ICU 
admission (4). In our study, the CURB-65 score pre- 
dicted ICU admission and in-hospital mortality bet- 
ter than the qCSI and the BCRSS scores. Neverthe- 
less, the qCSI score predicted ICU admission better 
than the BCRSS score. 


The BCRSS score, developed by the Italian Society 
of Infectious and Tropical Diseases, assesses the 
respiratory severity of COVID-19 pneumonia, show- 
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ing the patient’s need for oxygen and mechanical 
ventilation (15). It was demonstrated to be good at 
predicting severe illness and mortality (16). Howev- 
er, in our study, the predictive effect of the BCRSS 
score for ICU admission and in-hospital mortality 
was low. 


Our study had some limitations. Firstly, we conduct- 
ed a single-center and retrospective study. Secondly, 
we examined only three scoring systems for esti- 
mating the severity of COVID-19 disease. In addition, 
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we evaluated all measures only once at admission, 
so we could not assess changes in these scores. 


In conclusion, the qCSI score performed well in pre- 
dicting ICU admission, and the CURB-65 score pre- 
dicted ICU hospitalization and in-hospital mortali- 


ty. 


In contrast, the BCRSS score is poorly predictive 


of ICU admission and in-hospital mortality. Nevert- 
heless, we recommend that future studies evaluate 
the value and utility of COVID-19 risk classification 
models. 
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